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CHAPTER I 



INTRODUCTION 

Summary 

This research investigated the effectiveness of the 
Productive Thinking Program (Covington, Crutchfield, and 
Davies, 1966) in developing verbal creativity and problem 
solving abilities among pupils in grades four through seven. 
The program, which the writers considered an innovative 
attempt to provide direct instruction in creative problem 
solving, was studied in several ways. First, its effects 
on pupils’ verbal creativity scores, when intelligence and 
pre-test scores were statistically controlled, were examined. 
Next, the question of transfer from the. programed instruction 
to several problem solving criteria was investigated. These 
criteria consisted of a General Problem .Solving test, in- 
cluding both Type 0 and Type C problems (following Davis, 
1966); two forms of an Arithmetic Problem Solving test, to 
investigate non-specific transfer of learning to subject- 
matter problem solving; the Hake Up Problems test (Getzels 
and Jackson, 1962); and, an early form of the Childhood 
Attitude Inventory for Problem Solving (Covington, 1967). 

The final specific purpose of the study was to undertake an 
exploratory investigation of the internal structure or in- 
structional content of the programed materials. 
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Three hundred seventy pupils enrolled in 16 classes 
from six public school systems in central New York state 
participated in the study. There were four classes at each 
of the four grade levels studied. Two classes at each grade 
level were randomly assigned to the instructional condition; 
the remaining classes served as controls . Classes were 
generally similar with respect to socio-economic status, sex 
and intelligence distributions, and proportion of pupils with 
reading deficiencies . 

At each of the four grade levels there were significant 
differences favoring instructed pupils on the Childhood 
Attitude Inventory for Problem Solving (Part I, general 
attitudes, and Total Score). For verbal creativity, general 
problem solving, arithmetic problem solving (both forms), 
and Make Up Problems test scores there were no indications 
of a significant effect of the instructional treatment at 
any of the four grade levels studied. 

In order to investigate the internal structure of the 
instructional program, pupils ? written responses were analyzed, 
A randomly drawn sub -sample of twenty pupils from the instruc- 
tional group at each grade level was used for these analyses . 
Five general factors were identified as components of the 
175 responses required of pupils. These were: Memory- 

Organization; Production; Reorganization; Judgment -Evaluation ; 
and Attitudes . Correlations between pupils 1 scores on these 
factors and each of three creative problem solving criteria 



-o ~ 



(Verbal Creativity Total Score; Total Type 0 Problem Score; 
Total Type C Problem Score) were computed. At each grade 
level, and for each creative problem solving criterion, 
differences between correlations with the five factors were 
tested for significance. There were no significant differ- 
ences for any of the three creative problem solving criteria 
at any of the four grade levels . 

Then, for each of the five factors, and separately at 
each grade level, two groups were identified: pupils high 

on the. factor, and pupils low on the factor (approximately 
upper and lower thirds of the sub-sample) . For each factor, 
at each grade level, scores of these pupils and a randomly 
drawn sub-sample of control pupils were compared on each of 
the three creat5.ve problem solving criteria, controlling for 
IQ differences among groups. . Of sixty analyses, there were 
two significant F-ratios; these were interpreted as artifacts 



of the number of analyses conducted. 

The results of the study were interpreted in terms of 
three factors: the conditions under which the instructional 

materials were used (without teacher participation, one 
lesson per day on sixteen consecutive days); the difficulty 
of the criterion measures; and, the likelihood that more 
extensive training and practice must be offered to develop 
such complex cognitive abilities . 
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I ntroducti on 

Interest in creativity among psychological and educa- 
tional researchers in America is quite recent. Before the 
mid-twentieth Century, very little research in psychology 
or education was undertaken in the area of creative thinking. 
Early mental tests seldom included measures of creative 
thinking abilities, and even among those scholars who were 
interested in understanding what comprised the nature of 
intelligence, creativity received little attention (41). 

In 1950, J. P. Guilford, then President of the American 
Psychological Association, delivered an address in which he 
commented on the lack of research in this area, stated some 
propositions about possible relationships between creative 
thinking and human intellectual abilities in general, and 
described briefly a program of research which he and his 
colleagues were undertaking to investigate the nature of 
human intelligence as a multi -dimensional construct (36). 

Since then, research addressed to creative thinking has 
increased greatly in volume. Razik (55), for example, has 
prepared a bibliography of studies of creativity and problem 
solving which contains more than four thousand entries. That 
publication has already been supplemented by an additional 
review- covering the period from the publication of Razik T s 
bibliography through 1966 (9). 

Guilford himself has contributed, with his associates, 
to the study of creativity, both in terms of research addressed 
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to creative thinking and problem solving abilities and through 
the formulation of the Structure of Intellect Model which has 
shown considerable value as a heuristic device for researchers 
interested in human intelligence (37 s 41). 

The increase in volume of research in the area of crea- 
tive thinking has also been the subject of a recent paper by 
Guilford (40). He describes the acceleration of interest 
that has occurred since 1950 and proposes that it will probably 
continue. He proposes the need for research in two directions: 
first, toward a greater understanding of the process of 
creative thinking; and, toward a more complete understanding 
of the conditions that influence creative thinking. 

The great increase in research on creativity has also 
created serious problems for the scholar. Controversies 
have raged, and many are yet quite unsettled, concerning 
the definition of creativity, problems of measurement and 
assessment, and the feasibility of attempts to foster crea- 
tivity in educational settings. So much has the term ’'crea- 
tivity” been used in the psychological and educational liter- 
ature, and with such variation in meaning and usage, that 
many scholars now shun it as "unscientific.” Some scholars 
have been openly antagonistic to attempts at developing 
creative thinking abilities (2) . 

t 

As there has been considerable controversy and confusion 
among scholars concerned with creativity, Davis makes a 
similar observation about problem-solving research: 
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"Research in human problem solving has a well earned repu- 
tation for being the most chaotic of all identifiable cate- 
gories of human learning (25, p. 36)." This ’’chaos" has 
at least two dimensions: first, the lack of consistent 

general definition of problem solving among authors; second, 
the use of a large number of differing tasks as criteria 
for problem solving performance. These problems, in Davis’ 
view, lead to difficulty in comparing experimental results, 
and to an inability to make generally valid statements about 
problem solving. 

Many scholars, however, have continued to be fascinated 
with the investigation of creativity and problem solving. 

In addition to research directed towards understanding the 
nature of these abilities, there has been an increasing 
amount of research directed towards attempting to facilitate 
them through instruction. Some have attempted to ’’train’’ 
originality through verbal learning experimental procedures 
(46). Others have developed programs based on the "brain- 
storming” -approach (50, 51). Torrance and his associates 
have developed workbook materials, audio tapes, and records 
intended to help children develop creative thinking abilities 
(23, 47, 70). Covington, Crutchfield, and Davies have de- 
veloped a series of programed instructional materials which 
are designed to develop creative problem solving abilities 
and positive attitudes about creative thinking among elementary 
school pupils (17). 
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The importance of continuing research on creativity 
and problem solving has been stressed in several sources. 

The present writers, following Guilford (36, 40), Torrance 
(64, 65, 67, 68), Parnes (52), Covington (13, If), and others, 
contend that creativity and problem solving represents an 
area of critical importance in the psychological study of 
cognitive processes, as well as an area of research which 
has important social consequences. Guilford has, in the 
ODinion of these writers, stated the case tor the importance 

o. 

of research on creative thinking in a succinct way . 



It is apparent that the solutions to numerous 
human problems are dependent upon education . of the 
world’s population ... .An informed people... is a 
creative , problem-solving people. In a real . sense, 
mankind is involved in a race between expanding 
education on the one hand, and threatened disaster, 
perhaps oblivion, on the other. (40, p. l<i.) 

From the point of view of the educator, the proolem 
of facilitating the development of creative thinking and 
problem solving abilities through instruction is one of the 
most important in this area of research. Of course, the 
educator may well also be interested in better understanding 
the nature of these abilities, how they may be more effectively 
assessed among pupils, and the relationships among person- 
ality characteristics and these abilities. But the question, 
"What can we actually do to help pupils develop creative 
thinking and problem solving abilities?” remains critical. 

The present study is concerned with the development Ox 
creative thinking and problem solving abilities among pupils 
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in grades four through seven, through the use of a set of 
programed instructional materials, called the Productive 
Thinking Program (17). 

There are several important questions concerning the 
effectiveness of these materials which will be examined in 
this study. In addition to questions of the effectiveness 
of the instructional materials, other concerns are also 
addressed in this study. The materials are viewed as one 
approach, from among a number of possibilities, used in order 
to examine more carefully the general problem of facilitating 
creative thinking and problem solving abilities. It is 
necessary, then, to present in detail the problem to which 
this study addresses itself. The statement of the problem 
will be presented in two parts: first, an overview, or 
general statement of the problem; second, a detailed examin- 
ation of the specific components of the problem. 

Ge neral Statement of the Problem 

This study addresses itself, at the broadest level of 
description, to the question, "Can creative thinking and 
problem solving abilities be taught to pupils in grades 
four through seven by direct instruction?" 

The first general aspect of the problem is suggested 
by the" words "direct instruction." By direct instruction 
is meant an attempt to develop creative thinking and problem 
solving abilities in which the specific instructional content 
is creativity and problem solving as such. The Productive 
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Thinking Program (17)- constitutes one attempt at such direct 
instruction, and its effectiveness wi3.1 D6 systeina ticaily 
investigated at four grade levels. 

The second general aspect of the problem is comprised 
of questions dealing with the psychological study ox learning 
and transfer with respect to the abilities and attitudes 
which the instructional program proposes to develop. The 
authors of the instructional materials propose that such 
abilities and attitudes should be generalizable to a wide 
range of problem solving situations (22) . Althougn the 
question of transfer has been raised before (10, 56), there 
is little research evidence to support or deny conclusively 
Crutchfield and Covington’s position that positive transfer 
should occur. Another psychological issue which is addressed 
by this study has to do with the question, ”Wha t is learned? 
Although the programed instructional sequence has been utilized 
in several previous research projects, this rather important 
question has not yet been raised. In all of the studies 
which have been reported previously, it has either been 
assumed that the pupils learn from the program what its 
authors propose it teaches , or such considerations have not 
been made at all. Knowledge of what is learned by pupils 
who study the P roductive Th in king Prog ram, through classi- 
fication and analysis of pupils’ responses, is thus a major- 
aspect of the problem to which this study is addressed. 
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These general dimensions of the problem can be better 
understood through a detailed examination of more specific 
questions. Several such questions have been generated from 
the general statement of the problem; these will be presented 
as the specific statement of the problem. 

Specific Statement of the Proble m 

The specific questions to which this study is addressee, 
which have been developed from the general problem stated 
above, are classified according to: 

A. Those emerging from the first part of the. general state- 
ment of the problem, dealing specifically with the instruc- 
tional materials: 

1. What abilities are developed in the program? 

2. If some abilities are more effectively developed 
than others by the instructional materials, to what extent 
do the abilities taught bear differentially on pupils’ 
problem solving performance? 

3. At what grade level(s), if at all, may the in- 
structional materials be recommended for classroom use? 

4. To what extent, if at all, must the instructional 
materials be revised, modified, or supplemented by other 
activities for optimal effectiveness in the classroom? 

B. Those emerging from the second part of the general 

statement of the problem, dealing with the psychological 

questions of learning and transfer: 

5 ’, To what extent, if at all, does the instructional 
treatment (i.e., studying the Productive T hi nking Program ) 
facilitate performance on tests of verbal "creativity, when 
pre-test scores and IQ are statistically contro3.1ed? 
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6. To what extent, if at all, does what is learned 

or developed in the instructional treatment lead to positive 
transfer to general problem solving situations? 

7. To what extent, if at all, does the learning from 
the instructional treatment lead to positive transfer to 
arithmetic problem solving? (It should be noted that 
arithmetic problem solving has been selected as a form of 
problem solving representative of problems which pupils 
must typically confront in the classroom, rather than for 
any intrinsic relationship it might be thought to have with 
human problem solving or the s pecific content of the pro- 
gramed instructional materials'.) 

Previous Research with the Productive Thinking Program 



Covington and Crutchfield reported two studies with 
fifth-and sixth-grade pupils, in which a preliminary version 
of the instructional program (comprised of 13 rather than 
15 lessons) was used (16). 

In the first study, 195 pupils from Berkeley and vicinity 
participated. These pupils were from four fifth-grade and 
two sixth-grade classes. Two of the fifth-grade clasres 
and one of the sixth-grade classes were designated as in- 
structional groups; pupils in These classes studied the 13 
lesson programed sequence . The instructional materials 
were used for one hour per day for a three week period. 

Each child worked individually on each lesson. Control 
classes received a shorter set of booklets which did not 
provide instruction in creative problem solving. Following 
the training period, an eight hour post-test battery was 
administered to all pupils. A one -hour follow up test battery 
was also given five months later. 
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Pupils in both conditions were compared on several 
measures, including: number of problem-clarifying questions 

asked, number and rated quali-'ty of ideas generated, and number 
of solutions achieved. For each of these measures, the 98 
pupils in the instructional group markedly outperformed 
uninstructed pupils . Differences between proportions of 
pupils solving the problems in instructional and i.n control 
classes far exceeded statistical significance. On some 
problems, the instructed pupils outperformed controls by as 
much as a three to one ratio. Significant differences favor- 
ing pupils in the instructed classes were also observed on 
various tests of divergent thinking abilities. 

Follow up testing after five months showed continuing 
superiority for the instructed children over the control 
children . 



The second study reported by Covington and Crutchfield 

♦ 

utilized all 16 lessons which presently comprise the in- 
structional sequence. A total sample of 286 pupils was 
studied. Results again indicated marked superiority for 
instructed pupils over controls on several criterion measures . 
The f acilit at .ive effects of the program were stronger at 
the fifth -grade level than at the sixth -grade level, however, 
when data were analyzed separately by grade level. 

Ripple and Dacey have reported research in which a ten 
lesson experimental version of the program was used with 
eighth-grade pupils (24, 56). The total sample in this 
research consisted of 136 pupils from ten classes. Five 
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classes were randomly assigned to the instructional condition; 
pupils in these classes studied the instructional program. 
Pupils in control classes were given only their normal 
classroom instruction. All pupils in both instructional 
and control groups were given a post -test battery of diver- 
gent thinking measures, which were scored for imagination, 
fluency, flexibility, and originality. There were no sig- 
nificant differences between instructional and control 
pupils on any of these measures. Twenty-five pupils in each 
condition were asked to attempt to solve the Maier two string 



problem. Although slightly more pupils in tne instructed 
group successfully solved the problem than in the control 
group, the difference did not reach statistical significance. 
However, instructed pupils did solve the problem significantly 
f aster than control pupils. Although Ripple and Dacey 
concluded that their results supported non-specific transfer 
effects from the training materials to an actual problem 
solving criterion, their results were, on the whole, con- 
siderably ' less emphatic than those reported in the early 
studies by Covington and Crutchfield. Ripple and Dacey noted 
that the Covington and Crutchfield results were much less 



emphatic at the sixth-grade level than at the fifth, and 



suggested that it may be the c 
differently oriented programs 



ase that more challenging or 
are required as grade level 



increases . 
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Recent reports from the Berkeley Creativity Project 
have been of research with the programed instructional 
materials in several samples, all at the fifth-grade level. 

Covington reported data from, fifth-grade classes in 
the San Francisco Bay area (15). The instructed pupils in 
this study were administered the instructional program over 
a one month period. The instructional group (N=54) and the 
control group (N-54) were matched with respect to initial 
problem solving ability, IQ, and school achievement. Sex 
and racial distributions were comparable. Several criteria 
indicated that the post-test performance of the instructed 
pupils was generally superior to that of the control pupils . 
Measures included problem booklets with several multiple 
choice items presented at various stages in the problem 
sequence, designed to assess pupils’ choices of ideas and 
procedures, given the factual constraints of tne problem. 
Instructed pupils showed consistent superiority over con- 
trols on such items . Eleven instructed pupils , compared 
with only three control pupils, solved the problem during 
the early stages of presentation. Following the adminis tra- 
tion of several multiple choice questions, pupils were again 
directed to propose solutions. At this time, 15 additional 
pupils in the instructional group solved the problem, com- 
pared with five control pupils. Cov.ington observed that, 
although there was a decided training effect, it was also 
true that a large number of instructed pupils did not show 
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performance which differed from that of control pupils. He 
suggested that these results may point to the need for 
additional supplementary practice, revision of parts of the 
program, or both. 

Olton et al . , have reported another study in which 
the programed materials were used with fifth-grade pupils 
(49). In this study, 704 pupils from 44 fifth-grade classes 
in the Racine, Wisconsin public schools were involved. The 
instructional materials were used in 22 classes, one lesson 
per day, for four days of each of four school weeks. Students 
worked individually, at their own pace ; the teacher’s role 
was held to a minimum, emphasizing a test of the effective- 
ness of the materials themselves. Pre-and post-test batteries, 
including extensive problems thought to emphasize convergent 
thinking and divergent thinking, brief problems emphasizing 
convergent and divergent thinking, and a general verbal 
test intended to assess the proposed ’’master thinking skill” 
were administered. Mean performance of the instructed pupils 
surpassed ■ that of control pupils on 30 of the 40 internal 
and post-test measures . Eleven of those differences reached 
statistical significance. 

The authors observed that, although significant differ- 
ences favoring instructed pupils were found, such differences 
were of considerably smaller absolute magnitude than those 
indicated in previous studies (16). Failure to find larger 
differences was interpreted as reflecting differences between 
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the sutdies with respect to teacher involvement, and the 
pace at which the programed materials were administered to 
the pupils. In previous studies, classroom teachers were 
deliberately instructed to supplement the lessons (although 
that fact was not explicitly stated in the 1965 paper) . In 
addition, the materials had not been used as rapidly (almost 
one lesson each day) in previous studies. Olton et al . , 
concluded that large differences would not be likely to 
result from such a severe test of the materials. 

In more recent work several modifications in the pro- 
cedure for administering the programed materials have been 
made explicit (21). These include: 

(1) ’’spacing” of the administration of the lessons, 

so that at least one full day intervenes between the presen- 
tation of each lesson, and often slowing the pace to as few 
as two lessons per week over an eight week period; 

(2) increasing teacher involvement, utilizing a newly 
prepared Teacher ’ s Guide (18), including warm up and review 
discussions and ’’highlighting" key points of the lessons; 

(3) providing pupils with supplementary worksheets, 
which emphasize the "key point” of each lesson and provide 
the pupil with additional practice . 

.Recent research has utilized the programed instructional 
materials with these modifications . Results suggest that 
the instructed pupils are substantially superior to control 
pupils on a number of measures . A recently completed study 
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involved fifth -grade pupils in the San Francisco area. The 
programed lessons were administered at. the rate of two per 
week, over an eight week period. The program was supplemented 
by teacher discussions, ten to fifteen minutes in length, 
in conjunction with each lesson, and by using sixteen supple- 
mentary exercises. Instructed pupils were considerably 
superior to control pupils on most criterion measures. One 
criterion measure, intended to probe transfer effects to a 
typical classroom problem, involved writing an essay on 
"Poverty In Plenty." While instructed pupils’ descriptions 
of poverty did not differ from control pupils’ descriptions, 
instructed pupils made significantly more statements of 
possible causes of poverty. In addition, instructed pupils 

gave far greater (3:1 ratio) suggestions for "solutions" 

2 . 

to poverty (21). 



^The writers with to thank Dr. Robert Olton, of the 
Berkeley Creativity Project staff, for providing preliminary 
information about the results of this research, prior to the 
publication of the paper cited. 
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CHAPTER II 



METHODS AND PROCEDURES 



This Chapter will review the selection and assignment 
of pupils, the experimental materials, the procedures, and 
the measuring instruments used in this study. The treatment 
of the data will be discussed in detail and the reliability 
and validity of all measuring instruments will also be 
assessed. 

Selection and Assignment of Pupils 

This study involved pupils from 16 classes in grades 
four, five, six, and seven, from six public school systems 
in central New York State. There were four classes at 
each grade level. The school systems which participated 
were selected from approximately 30 public and parochial 
school systems in the area served by the Finger Lakes Region 
Supplementary Educational Center, a regional center under 
Title III of the Elementary and Secondary Education Act of 
1965, A summary of the participating classes and school 
systems, by grade level, is given in Ta.ble 1. 
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Table 1 

Participating Schools 



System 


Location 


Grades 


No. of Classes 










Union Springs 


Union Springs, N.Y. 


4, 


5 


4 


McGraw Central 


McGraw, N. Y. 


4, 


5, 6 


6 


Moravia Elemen . 


Moravia, N. Y. 


6 




1 


Cincinnatus 


Cincinnatus, N. Y. 


6 




1 


Interlaken 


Interlaken, N. Y. 


7 


. 


2 


Ovid 


Ovid, N. Y. 


7 




2 



Classes at each grade level were selected according to 
correspondence on the following criteria: 



(1) Classes should be generally similar with respect 
to distribution of verbal intelligence scores, and should 
not represent "homogeneous” groups; 

(2) Classes should reflect generally similar distribu- 
tion of socio— economic class levels , based on parental 
occupation data; 

(3) Classes should be similar with respect to total 
numbers of pupils reading one full year or more below grade 
level; 

(4) Classes should be similar with respect to distri- 
bution of male and female pupils (that is, similar propor- 
tions of boys and girls among classes at any grade level.) 

On the basis of these criteria, four classes at each 
grade level were identified to participate in the study. No 
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classes which satisfactorily met these criteria and were in- 
vited to participate in the study declined to be involved. 
Tables 2 through 7 summarize the comparisons of participating 
classes with respect to the selection criteria. Table 2 
summarizes the mean, standard deviation, and range of each 
class on the forge Thorndike Verbal Intelligence. Test (44) 
and Table 7 summarizes those data by grade level and treat- 
ment groups. Table 3 summarizes the distributions of parental 
occupation levels among all classes, based on the classifi- 
cation developed by Warner and his associates (7 7) . Table 
4 summarizes the number of pupils in each class reading one 

year or more below grade level, on the basis of standardized 

2 

test data provided by school administrators. Table 5 summar- 
izes the number of pupils in each participating class, by 



sexes . 

Since, except at the sixth-grade level, each school 
system was represented by two classes, assignment to experimental 
and control conditions was made randomly within school systems . 
That is, at each grade level, one class from each of two 
school systems was randomly selected for the experimental 



^"Pupils * scores in grades four, five, and six were^based 
on data from che Iowa Basic Skills tests, given either in 
May 1967 or September 1967. Seventh-grade classes received 
the California Reading Test in September 1967. 
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Table 2 

Lorge Thorndike Verbal Intelligence Test Scores^ 

(By Classes) 



o 

Class -Grade 


N 3 


Mean 


S. D. 


Range 


411 


28 


109.43 


15.19 


76-137 


421 


19 


107.16 


13.37 


84-141 


432 


28 


108.54 


17.66 


72-147 


. 442 


24 


103.04 


15.68 


76-134 


511 


21 


105.71 


14.07 


81-130 


521 


23 


105.96 


13.49 


80-138 


532 


23 


109.91 


16.49 


80-143 


542 


22 


105.00 


14.61 


74-131 


611 


26 


106.31 


15.48 


73-136 


621 


24 


108.96 


11.38 


73-128 


632 


27 


106.11 


14.08 


87-137 


642 


20 


103.25 


15.29 


73-132 


711 


21 


108.14 


16.08 


84-135 


721 


22 


116.00 


8.63 


101-131 


732 


18 


106.38 


16 .10 


69-129 


742 


29 


114.59 


11.25 


94-138 



^In grades four through six, Level Three, Form A, 
Verbal; in grade seven, Level Four, Form A, Verbal. 

2 

Identification code numbers for classes: Grade ('{-7), 
class number (1-4); condition (^instructional, -2 = control ) . 

3 ' 

Number of pupils present for testing (prior to pupil 
elimination based on incomplete pre-test data.) 
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Table 3 

Distribution of Parents' Occupational Levels 

By Grade and Class‘d 



Grade -Class 


No. 

N 


of 

1 


Parents 
2 3 


in 

4 


each 

5 


of 

6 


Warner 

7 


's Class Stra - 
Unclassified^ 


411 


31 


1 


4 


3 


5 


14 


3 


3. 


0 


421 


27 


2 


4 


2 


7 


6 


0 


0 


6 


432 


29 


1 


2 


4 


4 


12 


1 


0 


5 


442 


27 


1 


2 


4 


7 


8 


2 


3 


0 


511 


24 


1 


4 


3 


4 


12 


0 


0 


0 


521 


27 


0 


2 


3 


1 


13 


2 


1 


5 


532 


24 


3. 


3 


0 


4 


9 


5 


0 


2 


542 


25 


2 


2 


4 


3 


12 


0 


0 


2 


611 


25 


0 


0 


5 


5 


12 


1 


0 


2 


621 


28 


0 


6 


1 


5 


7 


1 


0 


8 


632 


27 


3 


1 


2 


2 


16 


2 


1 


0 


642 


29 


3 


1 


5 


4 


• 10 


4 


1 


1 


711 


27 


1 


3 


3 


3 


6 


2 


1 


8 


721 


24 


1 


6 


3 


2 


4 


2 


0 


6 


732 


29 


3 


6 


4 


0 


4 


4 


2 


6 


742 


24 


1 


4 


5 


3 


10 


1 


0 


0 



Based on the classification scheme used by Warner et 
al.j (I960); see p. 139-140. 

? 

'Unclassified includes pupils for whom data was not 
available, pupils under institutional or non -parental care, 
and occupational definitions which were unable to be 
classified in the strata identified by Warner et al ( , from 
the lists provided by the schools 
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Table 4 

Summary of Numbers of Pupils 
Reading One Year or More 
Below Grade Level (By Grades)"*' 





Grade, Class 


N 


No. (Pet.) 1 year or more 
Below Grade Level 



411 


31 


3 


(10.0) 


421 


27 


5 


(18.5) 


43 2 


29 


3 


(10.3) 


4 42 


27 


7 


(25.9) 


511 


24 


8 


(33.3) 


521 


27 


4 


(14.3) 


532 


24 


7 


(29.2) 


542 


25 


5 


(20.0) 


611 


25 


8 


(32.0) 


621 


28 


4 


(14.3) 


632 


27 


5 


(18.5) 


642 


29 


6 


(20.7) 


711 


27 


0 


( 0.0) 


721 


24 


8 


(33.3) 


732 


29 


O 


(10.4) 


742 


24 


5 


(20.8) 



J "From school permanent data provided by building 
principals. Based on Iowa Basic Skills Test Scores in 
grades four through six (May 1967 or September 1967), 
California Reading Test scores in grade seven (September 
1967). 
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Table 5: 

Summary of Sex Distributions 
(By Grade and Class ; 





Grade, Class 


Boys 


Girls 


Total N 



411 


10 


18 


28 


421 


12 


7 


19 


432 


12 


16 


28 


442 


12 


12 


24 


511 


10 


11 


21 


5 21 


10 


13 


23 


532 


7 


11 


18 


542 


10 


12 


22 


611 


14 


12 


26 


621 


14 


10 


24 


632 


13 


14 


27 


642 


9 


11 


20 


711 


10 


11 


21 


721 


9 


13 


22 


732 


10 


8. 


18 


742 


13 


16 


29 


Total 


175 


195 


370 



Based on classes after pupa.l elimination because of 
incomplete pre-test data. 
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Table 6 

Distribution of Pupils By Sex 
and Treatment Groups 



Grade 


- 


instructional Group 
Boys Girls 


Total N 


4 




22 


25 


47 


5 




20 


24 


44 


6 




28 


22 


50 


7 




19 


24 


43 


Total 




89 


95 


184 


Grade 




Non-Instructional Group 
Boys Girls 


Total N 


4 




24 


28 


52 


5 




17 


23 


40 


6 




22 


25 


47 


7 




23 


24 


47 


Total 




80 


100 


185 


Lorge 


Thorndike 


Table 7 

Verbal Intelligence Scores 






(By Grade 


Level and Condition 1 


r 


Grade 

Condition 


N 


Mean 


S. D. 


Range 


4 Instr. 


“47 


108.51 


14.37 


76-T41 


4 Con . 


52 


106.00 


16.84 


76-147 


5 Instr. 


44 


105.84 


13.61 


80-138 


5 Con . 


40 


108.73 


15.84 


74-143 


6 Instr. 


50 


107.58 


13.60 


73-136 


6 Con . 


47 


104.89 


14.51 


73-137 


7 Instr. 


43 


112.16 


13.27 


84-135 ' 


7 Con', 


47 


111.62 


13.69 


69-138 



In grades four through six, Level 3, Form A, Verbal; 
in Grade Seven, Level 4, Form A, Verbal, Based on rinal 
number of pupils with complete pre-test data. 
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to the control condition. At the sixth -grade level, classes 
from Moravia and Cincinnatus were assigned as if from the 
same school system (that is, one class served in the experi- 
mental condition and one served in the control condition) . 

Table 6 summarizes the distribution of pupils by sex and 
treatment groups. Table 7 summarizes the IQ scores by 
grade level and condition. 

The Experimental Instructional Materials 

Pupils in classes in the instructional condition studied 
the Productive Thinking Program developed by Covington, 
Crutchfield and Dc'ivies (17). This program consists of 
16 lessons designed to develop the pupil’s problem-solving 
skills and attitudes. It was originally designed to be used 
as a self-instructional program, and has been used entirely 
in that way for this study. It should be pointed out, however, 
that the authors of the program now feel that the. materials 
will not be optimally effective if used on an entirely self- 
instructional basis. Pupils in the experimental condition 
in this study were given one of the 16 booklets in the pro- 
gram on each of 16 consecutive school days in accord with 
the procedures followed during previous research with the 
program. Each booklet required about 40 minutes for comple- 
tion. It should also be noted that the authors of the pro- 
gram have recently recommended that the materials should 



^Dr. Robert Olton, personal communication, March, I960 
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be used in a less concentrated fashion in the classroom, 
perhaps even expanding the period of study to as long as 
eight weeks . 

T he Productive Thinking Program has been described in 
extensive detail in reports by Covington and Crutchfield 
(18) and by Covington, Crutchfield and Davies (18). 

Thus, for the requirements of this study, the program will 
be only briefly described. 

The 16 booklets comprising the Productive Thinking 
Program present the pupil with a series of mystery of 
detective problems. The pupils are first introduced or 
the characters of the story: Jim and Lila, typical upper 
elementary school age youngsters, and their Uncle John, a 
high school teacher in the town of Elmtown. Jim and Lila 
have come to Elmtown to live with- Uncle John while their 
parents go to Africa to work in the Peace Corps. The children 
soon see "Mr. Search," a mysterious detective who assists 
the local police department in solving difficult cases. 

They become interested in learning his identity. They soon 
discover that Uncle John is Mr. Search. This story line 
serves as the foundation for instruction in problem solving 
skills and attitudes. In order to teach Jim and Lila to 
become, better thinkers, Uncle John leads them through a 
variety of problem situations . The pupil studying the 
Productive Think ing Pro gram is assumed to identify with the 
characters and to become involved in their attempts to learn 



to be better thinkers. ; The principle of active involvement 
in the learning situation is established by asking the 
pupil to respond to the questions and problems as if he 
were in the same situation as Jim and Lila. ’’Feedback” is 
provided through extensive dialogue between Uncle John and 
the youngsters in the story, although emphasis is always 
placed on the value of independent thought and the possi- 
bility of a number of ’’correct” answers. 

The pupils encounter 16 "thinking guideposts” which 
are systematically introduced, utilized by the characters, 
and reviewed. There are also two opportunities for "self- 
tests” within the programed instructional sequence. The 
pupils are given opportunities to produce ideas , solve 
problems, evaluate the characters' answers and. attitudes, 
and to express their own attitudes . 

Thus, the content of the instructional materials is 
independent of the subject areas ordinarily included in the 
school curriculum. The program attempts to develop skills, 
abilities and attitudes about creative problem solving throug 
direct instruction. 

The "thinking guideposts" presented in the. program are: 

(1) Get the facts well in mind; reflect on the problem. 

(2) Decide what to work on first. 

(3) Be planful in your work . 

(4) Don’t jump to conclusions; keep an open mind. 

Think of many ideas . 



( 5 ) 



(6) 


Think of unusual and clever ideas . 


(7) 


Pick out each main person and object in the problem. 


(8) 


Use the "Idea Tree" (of main and particular ideas). 


(9) 


Almost anything can remind you of ideas, 


(10) 


Check ideas against the facts . 


(11) 


Pay attention to puzzling facts. 


(12) 


Try to explain puzzling facts. 


(13) 


Try to find one idea that explains everything. 


(14) 


Review the facts . 


(15) 


Look at the problem in a new way. 


(16) 


"Just suppose..." (that such and such is the case; 
how could it have come about?) 


The 


authors of the program contend that its content is 



"atheoretical, " in that it is not the product of 5 and is not 
dependent upon any theoretical formulation of problem solving. 
It is readily apparent, however, from the thinking guide- 
posts, that the program's content is generally compatible 

t 

with recent theoretical work on problem solving (e.g., 39, 41). 



Procedures 



Following the testing and data collection dealing 
with class selection procedures, all pupils were pre-tested 
on verbal creativity and. arithmetic skills. Pupils in grades 
four, five, and six were pre-tested in October and November 
1967 . Pupils in grade seven were pi^e -tested in February 1968. 

Immediately following the pre-testing period, pupils 
in the instructional condition classes began their work with 
the Productive Thinking Program . The instructional sequence, 
as noted above, consisted of one school period on each of 
sixteen consecutive school days. Control condition classes 
received only their ordinary classroom instruction. 

Final testing of all pupils was conducted on three 
successive days immediately following the sixteenth dciy of 
instruction for the experimental groups. In grades four, 
five, and six, post-tests were given in December 1967. In 
grade seven, post -tests were given in March 1968. The post- 
tests consisted of the following measures: 



1 . 



the Torrance Tests of Creative Thinking, Verbal 
Form A (68); 

2. the General Problem Solving Test; 

3. one of the two forms of the Arithmetic Problem Solving 
Test (each form given to half the pupils in a class, 
randomly selected) ; 

4. the Make Up Problems Test (34); 

5. a slightly modified form of the Childhood Attitude 
Inventory for Problem Solving (14) . 

Measuring Instruments 

Each of the measuring instruments used in this study 
will now be discussed in detail. Evidence for their relia- 
bility and validity will also be presented and discussed. 

1. Tests of Verbal Creativity . The measures of verbal 
creativity used were the Torrance Verbal Tests of Creative 
Thinking, Form A (68). This battery consists 
of seven sub-tests administered in one session in a paper 
and pencil format . Approximately 45 minutes are required 
for administration. Six of these sub-tests and several 
combined scores were used in the present study. 

The sub-tests used w<?re •: 

(a.) three Ask and Gues s tests (Asking Questions [AQ], 

Guessing Causes [GCa], and Guessing Consequences [GCo]); 

(b.) Unusual Uses of cardboard boxes (UU); 
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(c.) Product Improve ment of toy elephant (PI); 

(d.) Just Suppose clouds had strings (JS). 

Each sub-test was scored for one of the three components 
of the operational definition of creativity discussed in 
Chapter Two. Asking Questions and U nusual Uses were scored 
for flexibility. Guessing Causes and Product Improvement 
were scored for originality. Guessing Consequences and Just 
Suppose were scored for fluency. The decision to score 
each sub-test on only one of the three scoring dimensions 
was largely influenced by the practical consideration of 
economy in time and expense of scoring. The Ask and Guess 
tests were scored in the same pattern that Dacey used (2*0. 
The Un usual Uses task was scored for flexibility, in view 
of Torrance’s emphasis that the task challenges the subject’s 
ability to free his mind of a well established set (68, 
p. 12). The Just Suppose task was scored for fluency in 
view of the fact that Torrance considers it a ’’variation of 
the G uess Consequences task” (68, p. 13), which is scored 
for fluency (following 24, 57). The Product Improvement 
task was scored for originality. Torrance suggests that 
this task permits subjects "to play with ideas that they 
would not dare express in a more serious task," which sugges- 
ted to the writers an emphasis on originality . 

For the purposes of analysis, ten scores were used. 
First, each of the sax sub-tests was used separately. Next, 
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three combined scores (one each for fluency, flexibility, 
and originality) were used. Each of these was based on the 
arithmetic sum of the two tests scored for that dimension 
(following Torrance, 68), Finally, a composite total score 
was computed. Each of the six sub-test scores was converted 
to a standard score, based on a mean of 50 with a standard 
deviation of 10. (Standard Scores were computed separately 
for each of the four grade levels). The total score for each 
pupil was the arithmetic mean of the six standardized sub- 
test scores. 

Reliability . Table 8 summarizes the test -retest reliabili- 
ties for each of these ten scores over a three week period. 
These data are from control classes only, since no special 
instructional program assumed to relate to scores on such 
tests was provided for these pupils. 

All Fluency and Flexibility tasks were scored by two 
scorers, trained by the writer, using procedures recommended 

by Torrance (68). All originality scoring was done by one 
of these scorers, to reduce possible inter-scorer variation 
on that scoring dimension. Table 9 summarizes the mean and 
standard deviations of each scorer for all sub-tests, and pre- 
sents the coefficients of inter-scorer reliability (Pearson 
product -moment correlation coefficients) based on a sample 
of tests scored by both scorers. Table 10 presents 
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scorer stability coefficients for- originality sub-tests 
based on a sample of tests re-scored by the same scorer at 
the end of scoring (since the same scorer scored all orig- 
inality sub-tests.) These data suggest that the tests 
provided reliability levels sufficiently great to warrant 
the use of the tests in this study. 

Validity , Evidence for the validity of the Torrance Tests 
of Creative Thinking has been presented and discussed by 
Torrance (68) . This problem of validity has four principal 
aspects: content validity, concurrent validity, predictive 

validity, and. construct validity. The evidence presented 
by Torrance for the validity of the tests in each of these 
four aspects will be presented. Data from the present 
study will also be presented to supplement the evidence 
cited by Torrance . 

Torrance holds that the tests have content validity as 
a result of his consistent and deliberate effort "to base 
the test stimuli, the test tasks, instructions, and scoring 
procedures on the best theory and research now available." 
(68, p. 24). The theory and research which led to the 
development of the tests included analyses of the lives of 
indisputably eminent creative people, the nature of creative 
performance , and research and theory concerning the function- 
ing of the human mind. The test tasks are, further, free 
of technical or subject matter content. The complexity 
of creativity and theppresent state of test development does 





not make it possible to completely specify or assess crea- 
tive thinking abilities. 



Table 8 

Test-Retest Correlations: Torrance Tests of Creative Thinking 

(Control Pupils Only) 



Subtest 


Grade 

mm . km 

N 


4 

~~”r 


Grade 5 

R — — 


Grade 6 
“F 'r 


Gr a 


do 7 
r 


AQ 


52 


.62** 


39 


.59** 


45 


.45** 


44 


.43** 


GCa 


52 


.52** 


39 


.16 


45 


.23 


44 


,14 


GCo 


52 - 


.12 


39 


.52** 


26 


.35* 


44 


.46** 


PI 


52 


.61** 


39 


.59** 


45 


.61** 


44 


.34* 


UU 


52 


.36** 


39 


.31 


45 


.60** 


44 


.46** 


JS 


52 


.56** 


39 


.28 


26 


.58** 


44 


.27 


Flex. Sub-Ttl. 


52 


.57** 


39 


.56** 


45 


. o b “ " 


44 


.53** 


Flu. Sub-Ttl. 2 


52 


.33** 


39 


.64* * 


26 


.48** 


44 


.40** 


Orig. Sub-Ttl. 3 


52 


, 6 b “ " 


39 


.58** 


45 


.59** 


44 


.30* 


Standardized 


52 
















4 

Total Score 


52 


.65** 


39 


.69** 


26 


.54** 


44 


.52** 



^"Asking Questions and Unusual Uses 

Guessing Consequences and Just Suppose 

^Guessing Causes and Product Improvement 

•^Each of the scores in the six sub-test distributions 
was converted to a standard score, with X=50 and S.D.=10 
for each grade level. Total score was derived as the sum 
of the six standard scores, divided by six. 

* = p < . 05 

**=p<.01 
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Table 9 

Inter Scorer Reliability: Torrance 

Tests of Verbal Creativity 1 



Scorer One Scorer Two 



Sub-test 


X 


SD 


X 


SD 


r 


Asking Questions 


4.72 


2.25 


4.16 


2.57 


.73** 


Guessing Consequences 


3.32 


2.13 


3 .16 


2.22 


• 

CO 

»» 


Unusual Uses 


6.64 


3.27 


6.40 


2.85 


.91** 


Just Suppose 


5.48 


3.70 


5.20 


3.62 


.97** 


Flexibility Sub-Total 


11.36 


4.40 


10.56 


3.87 


.> 

CO 

CO 

• 


Fluency Sub -Total 


18.72 


4.9 6 


8.36 


5.01 


.88** 



^Based on a selected sample, N=25; Fluency and Flexibil- 
ity subtests only were scored by two scorei^s . 



*=p< . 05 

**=p<.01 



Table 10 

Coefficients of Stability of Scoring 
for Originality Sub-tests 1 



Sub-test 


Time 

T~~ 


3 . 

S.D. 


Time 
1< 


2 

S.D. 


r 


Guessing Causes 


3.00 


3.36 


3.17 


3.40 


. 916 * * 


Product Improvement 


5.26 


5. 34 


5.69 


7.03 


.941** 


Originality Sub -total 


8.26 


6.83 


3.17 


6.71 


.965** 



^Based on a randomly selected sample of tests, N=25. 
Stability coefficients for other sub-tests were also 
obtained from this scorer’s work . These ranged from .916 
to .995. 

**= p <.01 



o 
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Torrance recognizes this, although he does contend that, 
while the test tasks do not sample the entire universe of 
creative abilities, the Torrance tests do sample a wide 
range of such abilities (68, pp • 23-24). 

Evidence for the c oncurrent validity of the tests is 
difficult to assess, since there are no generally accepted 
criteria for such validation. A frequently used criterion 
is peer nominations or sociometric ratings. Yamamoto found 
that performance on selected sub-tests from the Torrance 
batteries correlated positively and significantly with 
sociometr-xo ratings obtained from secondary school pupils. 

(79, 82). Torrance also reports data from 33 elementary school 
classes (grades one through six) . He reports that children 
who tended to be perceived by other children as having good 
ideas also tended to score higher on the Ask and Guess 

tests in the Torrance battery. 

Another criterion with which pupils * scores nave fre- 
quently been compared is teacher nominations. Torrance 
reports several studies (63, 65, 71, 80), in which elementary 
and junior high school pupils’ scores were studied in relation 
to teachers' ratings. In these studies, pupils nominated by 
teachers as highest on fluency, flexibility, originality, 
and elaboration and those nominated as lowest on chese 
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dimensions were differentiated by the appropriate scores 
on the Torrance tests . Torrance and Gupta found 
that teachers were able to differentiate on fluency, 
flexibility, and originality, but not on elaboration (70). 
Similar results were reported by Yamamoto (80), and Nelson 
(48) also reported similar results for verbal test batter- 
ies, with sixth graders. 

In the present study, teacher ratings were also obtained. 
Teachers were provided with a definition of creative behavior 
developed by Dacey (24), and asked to observe their pupils 
accordingly for a one week period. Each teacher was then 
provided with a class list, and was asked to rank the pupils 
in his class (following a procedure previously employed by 
the writer (73). Copies of the definition and the ranking 
procedure are included as Appendix J. Correlations between 
Standardized Total Creativity Scores (Pre-Tests) and the 
teachers * rankings have been computed for thirteen of the 
sixteen teachers whose classes participated in the study. 

These correlations, summarized in Table 11, ranged from -104 
to .60. The mean correlation, computed using Fisher’s Z~ 
transformation procedure (33) was .37. 

Torrance (68, pp . 46-7) also reports research which 
demonstrated a positive relation between performance on the 
Torrance Tests of Creative Thinking and sales productivity 
among department store personnel (75, 76). 



